PATENT ABSTRACTS OF JAPAN 



(1 1)Publication number : 2000-1 15534 



(43)Date of publication of application : 21 .04.2000 



(51)lnt.CI. H04N 1/407 
G06T 5/00 
G06T 5/20 



(21) Application number : 10-277711 (71)Applicant : FUJI PHOTO FILM CO 
LTD 

(22) Date of filing : 30.09.1 998 (72)lnventor : ITO WATARU 



(54) METHOD AND DEVICE FOR PROCESSING PICTURE, AND 
RECORDING MEDIUM 



(57)Abstract: 

PROBLEM TO BE SOLVED: To compensate the contrast of a high light part and 
a shadow part while keeping the contrast of a main subject at the time of 
executing gradation conversion to picture data. 

SOLUTION: A gradation correcting means 1 converts the gradation of picture 
data Sorg by the gradation conversion curve of an S-shaped to obtain gradation 
converted picture data Sk. A sharpness correcting means 2 obtains processed 
picture data Sproc by executing sharpness emphasizing processing to data Sk 
so as to increase an emphasizing degree along with the reduction of the 
inclination of the gradation conversion curve. An emphasizing coefficient for 
fixing the emphasizing degree is fixed by a correcting amount controlling means 



* NOTICES * 



JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

LThis document has been translated by computer. So the translation may not 
reflect the original precisely. 

2.**** shows the word which can not be translated. 
3.ln the drawings, any words are not translated. 

CLAIMS 

[Claim(s)] 

[Claim 1]As opposed to image data which has a dynamic range larger than a 
dynamic range of a picture output means, In an image processing method which 
performs gray-scale-conversion processing to said image data so that a dynamic 
range of this image data may be settled in a dynamic range of said picture output 
means, To said image data, perform gray-scale-conversion processing with a 
predetermined gray-scale-conversion curve, and gray-scale-conversion finishing 
image data is obtained so that a dynamic range of this image data may be 
settled in a dynamic range of said picture output means, An image processing 
method performing sharpness emphasis processing according to inclination of 



said gray-scale-conversion curve, and obtaining processed image data to said 
gray-scale-conversion finishing image data. 

[Claim 2]The image processing method according to claim 1 performing said 
sharpness emphasis processing only to a highlight part of a picture expressed 
by said image data. 

[Claim 3]As opposed to image data which has a dynamic range larger than a 
dynamic range of a picture output means characterized by comprising the 
following, An image processing device which performs gray-scale-conversion 
processing to said image data so that a dynamic range of this image data may 
be settled in a dynamic range of said picture output means. 
A gray-scale-conversion means to perform gray-scale-conversion processing 
with a predetermined gray-scale-conversion curve, and to obtain 
gray-scale-conversion finishing image data to said image data so that a dynamic 
range of this image data may be settled in a dynamic range of said picture output 
means. 

A sharpness compensation means which performs sharpness emphasis 
processing according to inclination of said gray-scale-conversion curve, and 
obtains processed image data to said gray-scale-conversion finishing image 
data. 



[Claim 4]The image processing device according to claim 3, wherein said 
sharpness compensation means is a means to perform said sharpness 
emphasis processing only to a highlight part of a picture expressed by said 
image data. 

[Claim 5]As opposed to image data which has a dynamic range larger than a 
dynamic range of a picture output means characterized by comprising the 
following, A recording medium which recorded a program for making a computer 
perform an image processing method which performs gray-scale-conversion 
processing to said image data so that a dynamic range of this image data may 
be settled in a dynamic range of said picture output means and in which 
computer reading is possible. 

A procedure of said program performing gray-scale-conversion processing with 
a predetermined gray-scale-conversion curve to said image data so that a 
dynamic range of this image data may be settled in a dynamic range of said 
picture output means, and obtaining gray-scale-conversion finishing image data. 
A procedure of performing sharpness emphasis processing according to 
inclination of said gray-scale-conversion curve, and obtaining processed image 
data to said gray-scale-conversion finishing image data. 

[Claim 6]A recording medium in which the computer reading according to claim 5 



is possible, wherein a procedure of obtaining said processed image data is a 
procedure of performing said sharpness emphasis processing only to a highlight 
part of a picture expressed by said image data. 



DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Field of the lnvention]As opposed to the image data which has a dynamic range 
in which this invention is larger than the dynamic range of image output devices, 
such as a printer, It is related with the recording medium which recorded the 
program for making a computer perform the image processing method which 
performs gray-scale-conversion processing in an image output device so that an 
output may be possible, a device, and an image processing method and in which 
computer reading is possible. 
[0002] 

[Description of the Prior ArtJThe dynamic range which image output devices, 
such as a printer, have, Since it is narrower than the dynamic range of imaging 
devices, such as CCD which acquires image data, If the image data obtained in 



the imaging device is outputted in an image output device as it is, the highlight 
part and shadow part in the picture expressed by image data will be crushed, 
and picture information will be lost. For this reason, it is possible to make 
gradation of the whole image data loose so that the dynamic range of image 
data may be settled in the dynamic range of an image output device. Thus, 
although the gradation of the highlight part of the picture expressed by image 
data by changing the gradation of image data and a shadow part can be 
expressed, since the gradation of a major object portion also becomes loose, the 
picture of gray-scale-conversion finishing drawing will be the thing of an 
impression which faded. For this reason, gray-scale-conversion processing is 
performed to image data with the gray-scale-conversion curve which has a curve 
of S shape as shown in drawing 7 , and he is trying to settle the dynamic range of 
image data in the dynamic range of an image output device, maintaining the 
gradation of a major object portion. 

[0003]However, since the gradation of a highlight part and a shadow part will 
become still looser if the gray-scale-conversion curve of S shape which was 
mentioned above performs gray-scale-conversion processing, It will become 
impossible to reproduce fine signs that the contrast in the high concentration 
portion and low concentration portion in a picture falls, for example, it is 
contained in a bride's white clothes in the photograph of a marriage ceremony. 



[0004]For this reason, the image processing method which made the picture 
reproducible is proposed, without losing the information on a highlight part and a 
shadow part by dividing a picture into a high concentration region and a low 
concentration area, and performing gray-scale-conversion processing which is 
different in each field, respectively (J P, 5-64229, A). 
[0005] 

[Problem(s) to be Solved by the lnvention]However, the method indicated to 
above-mentioned JP,5-64229,A, When a picture can divide into a high 
concentration region and a low concentration area clearly, it is satisfactory, but 
when the boundary of a high concentration region and a low concentration area 
is not clear, there is a possibility that the balance of gradation may collapse in 
the boundary part, and the artifact may occur. 

[0006]This invention is made in view of the above-mentioned situation, With the 
gray-scale-conversion curve of S shape which was mentioned above. As 
opposed to image data. Gray-scale-conversion processing. The recording 
medium which recorded the program for making a computer perform the image 
processing method with which the fall of the contrast of the highlight part at the 
time of giving and a shadow part can be compensated, a device, and an image 
processing method and in which computer reading is possible. It aims at 
providing. 



[0007] 

[Means for Solving the Problem]As opposed to image data which has a dynamic 
range in which an image processing method by this invention is larger than a 
dynamic range of a picture output means, In an image processing method which 
performs gray-scale-conversion processing to said image data so that a dynamic 
range of this image data may be settled in a dynamic range of said picture output 
means, To said image data, perform gray-scale-conversion processing with a 
predetermined gray-scale-conversion curve, and gray-scale-conversion finishing 
image data is obtained so that a dynamic range of this image data may be 
settled in a dynamic range of said picture output means, To said 
gray-scale-conversion finishing image data, sharpness emphasis processing 
according to inclination of said gray-scale-conversion curve is performed, and 
processed image data is obtained. 

[0008]Here, "a predetermined gray-scale-conversion curve" means a 
gray-scale-conversion curve of S shape as shown in drawing 7 mentioned above. 
[0009]"Sharpness emphasis processing according to inclination of a 
gray-scale-conversion curve" means that sharpness in a portion with small 
inclination, i.e., a highlight part, and a shadow part of a gray-scale-conversion 
curve performs sharpness emphasis processing so that inclination of a 
gray-scale-conversion curve may be emphasized rather than a large portion. It 



may be better not to perform sharpness emphasis processing, since a noise is 
conspicuous in a shadow part. Therefore, what is necessary is to perform 
sharpness emphasis processing only at a highlight part in such a case. 
[0010]As opposed to image data which has a dynamic range in which an image 
processing device according [ this invention ] to this invention is larger than a 
dynamic range of a picture output means, An image processing device which 
performs gray-scale-conversion processing to said image data so that a dynamic 
range of this image data may be settled in a dynamic range of said picture output 
means is characterized by comprising: 

A gray-scale-conversion means to perform gray-scale-conversion processing 
with a predetermined gray-scale-conversion curve, and to obtain 
gray-scale-conversion finishing image data to said image data so that a dynamic 
range of this image data may be settled in a dynamic range of said picture output 
means. 

A sharpness compensation means which performs sharpness emphasis 
processing according to inclination of said gray-scale-conversion curve, and 
obtains processed image data to said gray-scale-conversion finishing image 
data. 

[001 1]A program for making a computer perform an image processing method 



by this invention may be recorded on a recording medium in which computer 

reading is possible, and may be provided. 

[0012] 

[Effect of the lnvention]According to this invention, gray-scale-conversion 
processing is performed to image data with the gray-scale-conversion curve of S 
shape which was mentioned above, and gray-scale-conversion finishing image 
data is obtained. In this gray-scale-conversion finishing image data, although the 
contrast of the major object portion is maintained, the contrast of a highlight part 
or a shadow part has fallen. For this reason, when inclination performs 
sharpness emphasis processing with a stronger smaller portion to this 
gray-scale-conversion finishing image data according to inclination of a 
gray-scale-conversion curve, The sharpness of a highlight part or a shadow part 
is emphasized, and, thereby, the picture information in a highlight part or a 
shadow part comes to be reproduced in the reproduced image of processed 
image data. Therefore, although the contrast of a major object is maintained, the 
processed image data which compensated a fallen part of the contrast of a 
highlight part or a shadow part can be obtained. 

[0013]Since a noise is conspicuous in a shadow part, if sharpness emphasis 
processing is performed, a noise will be emphasized, and there is a possibility 
that the picture acquired by reproducing processed image data may become 



rather hard to see. Therefore, since sharpness is not emphasized to a shadow 
part by performing sharpness emphasis processing only to a highlight part, a 
noise can be prevented from being conspicuous in a shadow part. 
[0014] 

[Embodiment of the lnvention]With reference to drawings, the embodiment of 
this invention is described below. 

[0015] Drawing 1 is a schematic block diagram showing the composition of the 
image processing device by the embodiment of this invention. As shown in 
drawing 1 , the image processing device by this embodiment is provided with the 
following. 

A gray-level-correction means 1 to perform gray-scale-conversion processing 
with the gray-scale-conversion curve of S shape to image data Sorg, and to 
obtain the gray-scale-conversion finishing image data Sk. 

The sharpness compensation means 2 which performs sharpness emphasis 
processing to the gray-scale-conversion finishing image data Sk, and obtains 
processed image data Sproc. 

The correction amount control means 3 which controls the correction amount of 
the sharpness in the sharpness compensation means 2. 

[0016]The gray-level-correction means 1 performs gray-scale-conversion 



processing to image data Sorg with the gray-scale-conversion curve of S shape 
as shown in drawing 2 . Here the gray-scale-conversion curve shown in drawing 
2_so that the dynamic range of image data Sorg may be settled in the dynamic 
range of a printer, Although it is a straight line which has the inclination which 
does not change a dynamic range about the intermediate density portion 
(portion A) with which it is for performing gray scale conversion to image data 
Sorg, and a major object part is expressed, About the highlight part (portion B) 
and the shadow part (portion C), the inclination is loose. Therefore, if 
gray-scale-conversion processing is performed to image data Sorg with such a 
gray-scale-conversion curve, the contrast of a major object portion will be 
maintained, but contrast will fall about a highlight part and a shadow part. 
Actually, the gray-level-correction means 1 has a gray-scale-conversion curve 
shown in drawing 2 as a gray-scale-conversion look-up table, performs the 
operation shown in the following formula (1), and obtains the 
gray-scale-conversion finishing image data Sk. 
[0017] 

Sk=f(Sorg)(1) 

However, f : the gray-scale-conversion look-up table sharpness compensation 
means 2, So that a part for the contrast drop of the highlight part in the 
gray-scale-conversion finishing image data Sk obtained in the 



gray-level-correction means 1 and a shadow part may be compensated, 
Sharpness emphasis processing is performed to the gray-scale-conversion 
finishing image data Sk by the formula of the sharpness emphasis processing 
shown in the following formula (2), and processed image data Sproc is obtained. 
[0018] 

Sproc=Sk+K-g (f (Sorg)) and (Sk-Skus) (2) 

However, the function K whose differentiation g:after-mentioned f :f does: The 
Japanese quince mask signal of constant Skus:Sk 

Here, in a formula (2), the emphasis amount of sharpness is dependent on the 
emphasizing coefficient g (f (Sorg)), and this emphasizing coefficient is 
determined in the correction amount control means 3. That is, f is the 
differentiation of the gray-scale-conversion look-up table f mentioned above, and 
as shown in drawing 3 , let it be the function that the value of the intermediate 
density portion corresponding to a major object is set to 1 , and a value is set to 0 
in a low concentration part and a high concentration part. On the other hand, as 
shown in drawing 4 , in a portion with a small value, it has a value to f (Sorg) 
rather than 1 , and the function g is a function to which a value becomes large, so 
that it is close to 0. K is the constant set up beforehand, for example, is set to 2.0. 
[0019]Thus, about an intermediate density portion, the value off (Sorg) is set to 
1 by performing sharpness emphasis processing by a formula (2), and since the 



value of the emphasizing coefficient g (f (Sorg)) turns into a value near 0, even if 
it is emphasized whether sharpness is emphasized, it will become small [ the 
extent ]. On the other hand, about a highlight part and a shadow part, since the 
value of f (Sorg) turns into a value near 0 and the value of the emphasizing 
coefficient g (f (Sorg)) turns into a value near 1, sharpness will be emphasized. 
Therefore, as strong sharpness emphasis processing as the portion to which 
gray-scale-conversion processing was performed by the gray-scale-conversion 
look-up table f, and contrast fell is performed, In the reproduced image which 
reproduced processed image data Sproc by this, the fine picture information of a 
highlight part and a shadow part becomes reproducible, and, as a result, the fall 
of the contrast by gray-scale-conversion processing can be compensated. 
[0020]Subsequently, operation of this embodiment is explained. Drawing 5 is a 
flow chart which shows operation of this embodiment. First, 
gray-scale-conversion processing is performed based on the formula (1) 
mentioned above by the gray-level-correction means 1 to image data Sorg in 
Step S1 , and the gray-scale-conversion finishing image data Sk is obtained. The 
gray-scale-conversion finishing image data Sk is inputted into the sharpness 
compensation means 2 and the correction amount control means 3. In the 
correction amount control means 3, the emphasizing coefficient g (f (Sorg)) in 
the formula (2) mentioned above is determined (Step S2), and it is inputted into 



the sharpness compensation means 2. In the sharpness compensation means 2, 
based on the determined emphasis amount g (f (Sorg)), sharpness emphasis 
processing is performed to the gray-scale-conversion finishing image data Sk by 
the above-mentioned formula (2), and processed image data Sproc is obtained 
(Step S3). Obtained processed image data Sproc is outputted to image output 
devices (un-illustrating), such as a printer, and is reproduced (step S4). 
[0021]Thus, as shown in drawing 2 according to this embodiment, when 
performing gray-scale-conversion processing to image data Sorg with the 
gray-scale-conversion curve of S shape, Sharpness that it was made to perform 
emphasis processing as the highlight part and shadow part it becomes loose a 
gray-scale-conversion curved inclining so that the grade of emphasis might 
become large A sake, The picture information in a highlight part or a shadow part 
comes to be reproduced in the reproduced image of processed image data 
Sproc. Therefore, although the contrast of a major object is maintained, 
processed image data Sproc which can reproduce the picture which 
compensated a fallen part of the contrast of a highlight part or a shadow part can 
be obtained. 

[0022]Although the value of K in a formula (2) is made into the constant in the 
above-mentioned embodiment, the following formula (3) may be made to 
perform sharpness emphasis for K as a function of image data Sorg. 



[0023] 

Sproc=Sk+K (Sorg), g (f (Sorg)), and (Sk-Skus) (3) 

What is necessary is here, to set a value to 0 in the low concentration part of 
image data Sorg, and just to consider it as a function which has as big a value 
(for example, 2.0) as a high concentration part as K (Sorg), as shown in drawing 
6. Thus, by considering it as the function of image data Sorg as shows drawing 6 
K, the sharpness emphasis in a shadow part is set to 0, and sharpness 
emphasis will be carried out only to a highlight part. There is a possibility of 
becoming what has a picture rather hard to see acquired when a noise will be 
emphasized if sharpness emphasis processing is performed and processed 
image data Sproc is reproduced, since the low concentration part in a picture is 
[ a noise ] dramatically conspicuous here. Therefore, since sharpness is not 
emphasized to a shadow part by considering it as the function of image data 
Sorg as shows drawing 6 the value of K like the above-mentioned formula (3), a 
noise can be prevented from being conspicuous in a shadow part. 
[0024]ln the above-mentioned embodiment, although sharpness emphasis 
processing has been performed by the formula (2) or the formula (3), Not the 
thing limited to this but J P, 5-244508, A, The various sharpness emphasis 
processing methods, such as a method of the Laplacian pyramid or wavelet 
transform which was indicated to 6-274614 decomposing image data into 



4. 

multiple resolution space, and performing sharpness emphasis for every 
frequency band, are applicable to this invention. 



DESCRIPTION OF DRAWINGS 

[Brief Description of the Drawings] 

[Drawing 1] The schematic block diagram showing the composition of the image 

processing device by the embodiment of this invention 

[Drawing 2] The figure showing S shape gray-scale-conversion curve 

[Drawing 3] The figure showing the function by the differentiation of a 

gray-scale-conversion look-up table 

[Drawing 4] The figure showing the function g 

[Drawing 5] The flow chart which shows operation of this embodiment 
[Drawing 6] The figure showing the function K (Sorg) 
[Drawing 7] The figure showing S shape gray-scale-conversion curve 
[Description of Notations] 

1 Gray-level-correction means 

2 Sharpness compensation means 

3 Correction amount control means 
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